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Abstract 

■ The numerical range of a matrix is studied geometrically via the cone of positive 

semidefinite matrices (or semidefinite cone for short). In particular it is shown that 
the feasible set of a two-dimensional linear matrix inequality (LMI), an affine section 
of the semidefinite cone, is always dual to the numerical range of a matrix, which is 
therefore an affine projection of the semidefinite cone. Both primal and dual sets can 
also be viewed as convex hulls of explicit algebraic plane curve components. Several 
' numerical examples illustrate this interplay between algebra, geometry and semidef- 

inite programming duality. Finally, these techniques are used to revisit a theorem in 
| statistics on the independence of quadratic forms in a normally distributed vector. 
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> 1 Notations and definitions 

X 

The numerical range of a matrix A G C nxn is denned as 

W(A) = {w*Aw G C : w G C\ w*w = 1}. (1) 

It is a convex closed set of the complex plane which contains the spectrum of A. It 
is also called the field of values, see [3 Chapter 1] and [T2], Chapter 1] for elementary 
introductions. Matlab functions for visualizing numerical ranges are freely available from 
[2] and [EE]. 

Let 

A + A* . A -A* 
Ao = I n , A=— ^— , A 2 = ^— (2) 

with denoting the identity matrix of size n and % denoting the imaginary unit. Define 
T{A) = {y G P 2 : F(y) = y A + y x A x + y 2 A 2 y 0} (3) 
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with y meaning positive semidefinite (since the A{ are Hermitian matrices, F(y) has 
real eigenvalues for all y) and P 2 denoting the projective real plane, see for example P, 
Lecture 1]. Set J 7 (A) is a convex cone, a linear section of the cone of positive semidefinite 
matrices (or semidefinite cone for short), see [H Chapter 4]. Inequality F(y) ^ is called 
a linear matrix inequality (LMI). In the complex plane C, or equivalently, in the affine real 
plane M 2 , set J 7 {A) is a convex set including the origin, an affine section of the semidefinite 
cone. 

Let 

p(y) = det(yo-4o + y\Ax + y 2 A 2 ) 
be a trivariate form of degree n defining the algebraic plane curve 

V = {y G P 2 : p(y) = 0}. (4) 

Let 

Q = {x G P 2 : q(x) = 0} (5) 

be the algebraic plane curve dual to V, in the sense that we associate to each point 
y G V a point x G Q of projective coordinates x = (dp(y)/dyo, dp(y)/dyi, dp(y)/dy2). 
Geometrically, a point in Q corresponds to a tangent at the corresponding point in Q, 
and conversely, see [T7J Section V.8] and [6j Section 1.1] for elementary properties of dual 
curves. 

Let V denote a vector space equipped with inner product (.,.). If x and y are vectors 
then (x, y) = x*y. If X and Y are symmetric matrices, then {X, Y) = trace(X*Y). Given 
a set /C in V, its dual set consists of all linear maps from /C to non-negative elements in 
M., namely 

K? = {y e V : (x,y) > 0, x G £}. 

Finally, the convex hull of a set /C, denoted conv/C, is the set of all convex combinations 
of elements in JC. 



2 Semidefinite duality 

After identifying C with M 2 or P 2 , the first observation is that numerical range W(A) is 
dual to LMI set J 7 (A), and hence it is an affine projection of the semidefinite cone. 

Lemma 1 W(A) = F(A)* = {((A Q , W), (A u W), (A 2 , W)) G P 2 : W G C nxn , W h 0}. 

Proof: The dual to J 7 (A) is 

T{A)* = {x : (x,y) = (F{y),W) = j: k (A k ,W)y k >0, W h 0} 
= {x : x k = (A k ,W), WhO}, 

an affine projection of the semidefinite cone. On the other hand, since w*Aw = w*Aiw + 
% w*A 2 w, the numerical range can be expressed as 

W{A) = {x = (w*A w, w*A 1 w, w*A 2 w)} 

= {x : x k = (A k , W),W h0, rank W = 1}, 
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the same affine projection as above, acting now on a subset of the semidefinite cone, 
namely the non-convex variety of rank-one positive semi definite matrices W = ww*. Since 
w*A w = 1, set W{A) is compact, and convW(A) = J 7 (A)*. The equality W(A) = J 7 (A)* 
follows from the Toeplitz-Hausdorff theorem establishing convexity of W(A), see [T2| 
Section 1.3] or Theorem 1.1-2]. □ 

Lemma [1] indicates that the numerical range has the geometry of planar projections of the 
semidefinite cone. In the terminology of [U Chapter 4], the numerical range is semidefmite 
representable. 

3 Convex hulls of algebraic curves 

In this section, we notice that the boundaries of numerical range W(A) and its dual LMI 
set J 7 (A) are subsets of algebraic curves V and Q defined respectively in @ and (|3j), and 
explicitly given as locii of determinants of Hermitian pencils. 

3.1 Dual curve 

Lemma 2 J 7 (A) is the connected component delimited by V around the origin. 

Proof: A ray starting from the origin leaves LMI set J 7 (A) when the determinant p(y) = 
det UkA k vanishes. Therefore the boundary of J- (A) is the subset of algebraic curve 
V belonging to the convex connected component containing the origin. □ 

Note that V, by definition, is the locus, or vanishing set of a determinant of a Hermitian 
pencil. Moreover, the pencil is definite at the origin so the corresponding polynomial p(y) 
satisfies a real zero (hyperbolicity) condition. Connected components delimited by such 
determinantal locii are studied in [9], where it is shown that they correspond to feasible 
sets of two-dimensional LMIs. A remarkable result of [9] is that every planar LMI set 
can be expressed this way. These LMI sets form a strict subset of planar convex basic 
semi-algebraic sets, called rigidly convex sets (see [9] for examples of convex basic semi- 
algebraic sets which are not rigidly convex). Rigidly convex sets are affine sections of the 
semidefinite cone. 

3.2 Primal curve 

Lemma 3 W(A) = conv Q. 

Proof: From the proof of Lemma (TJ a supporting line {x : Ylk x kUk = 0} to W(A) has 
coefficients y satisfying p(y) = 0. The boundary of W(A) is therefore generated as an 
envelope of the supporting lines. See [15], [131 Theorem 10] and also [5j Theorem 1.3].D 

Q is called the boundary generating curve of matrix A in [13]. An interesting feature is 
that, similarly to V, curve Q can be expressed as the locus of a determinant of a Hermitian 
pencil. Following [5], given two matrices A, B of size m-by-n with respective entries A rc 
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and B rc , r 



1, . . . , m, c = 1, . . . , n, we define the second mixed compound [A, B] of size 
m(m — l)/2-by-n(n — l)/2 as the matrix with entries 



[A,B] R)C = ~(A riCl B r2C2 + A 



r„;C2-E'r 1 Ci 



A R —A R 



C2 I 



with row indices R = (ri,r 2 ) and column indices C = (01,02) corresponding to lexico- 
graphically ordered pairs such that 1 < r\ < r2 < m and 1 < c\ < C2 < n. 



Lemma 4 



q(x) = det 



x I n xj n x 2 I n 

x I n [A ,A ] [A^Aq] [A ,A 2 ] 

xj n [A h A ] [A!,Ai] [A h A 2 ] 

x 2 I n [A 2 ,A ] [A 2 ,Ai\ [A 2 ,A 2 ] 



Proof: See [5j Theorem 2.4]. □ 

Note that even though curve Q can be expressed as the determinantal locus of a Hermitian 
pencil, the pencil is not homogeneous and it cannot be definite. Hence the convex hull 
W(v4) is not a rigidly convex LMI set, it cannot be an affine section of the semidefinite 
cone. However, as noticed in Lemma [H it is an affine projection of the semidefinite cone. 



4 Examples 



4.1 Rational cubic and quartic 





Figure 1: Left: LMI set J 7 (A) (gray area) delimited by cubic V (black). Right: numerical 
range W(A) (gray area, dashed line) convex hull of quartic Q (black solid line). 
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and 



p(y) = (vo - yi)(yo + yi) 



2/02/1 



defines a genus-zero cubic curve V whose connected component containing the origin is 
the LMI set J 7 {A), see Figure [U With an elimination technique (resultants or Grobner 
basis with lexicographical ordering), we obtain 

q(x) = Ax\ + 32x2 + 13x^2 — 1820X1X2 + ^ x o x \ ~ 27xlxl 

defining the dual curve Q, a genus-zero quartic with a cusp, whose convex hull is the 
numerical range W(A), see Figured] 



4.2 Couple of two nested ovals 





Figure 2: Left: LMI set J 7 (A) (gray area) delimited by the inner oval of quartic V (black 
line). Right: numerical range W(A) (gray area) delimited by the outer oval of octic Q 
(black line). 



For 



A 



2 l + 2i 

10 

% 1 

+ i i 



the quartic V and its dual octic Q both feature two nested ovals, see Figure [2 The inner 
oval delimited by V is rigidly convex, whereas the outer oval delimited by Q is convex, 
but not rigidly convex. 



Figure 3: Left: LMI set J 7 (A) (gray area) delimited by the inner oval of quartic V (black 
line). Right: numerical range W(A) (gray area) delimited by the outer oval of twelfth- 
degree Q (black line). 

4.3 Cross and star 

A computer-generated representation of the numerical range as an enveloppe curve can 
be found in 0, Figure 1, p. 139] for 



A = 
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We obtain the quartic 

p(y) = ^(6% 4 - 52y 2 y 2 1 - 52y 2 y 2 2 + y\ + My\y\ + y\) 
and the dual twelfth-degree polynomial 

q(x) = 51844 2 - 299520xJ°a;2 - 299520xJ°a;2 + 1954576^ 

+16356256:4^ + 1954576x^ - 5375968x^5 - 79163552x^x 2 , 
-79163552x[jx?x^ - 5375968x^2 + 7512049x£x? + 152829956x^xfx| 
-2714586x^x| + 152829956x^xfx| + 7512049xgx| - 5290740xgxJ° 
-136066372x 2 1 x?x 2 . + 232523512x 2 1 x?x^ + 232523512x 2 ^x 2 i - 136066372x 2 ) x 2 x| 
-5290740x 2 xi° + 1498176xf + 46903680x}°x| - 129955904x?x| 
+ 186148096^ - 129955904a#c§ + 46903680x?x^° + 1498176x^ 2 

whose corresponding curves and convex hulls are represented in Figure [3J 
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Figure 4: Left: LMI set J 7 (A) (gray area) intersection of cubic (black solid line) and conic 
(gray line) LMI sets. Right: numerical range W(A) (gray area, black dashed line) convex 
hull of the union of a quartic curve (black solid line) and conic curve (gray line). 

4.4 Decomposition into irreducible factors 

Consider the example of Figure 6, p. 144] with 

1 1 
000001000 
000000100 
000000010 
A = 000000001 
000000000 
000000000 
000000000 
000000000 

The determinant of the trivariate pencil factors as follows 

1 



p(y) 



256 



(% 3 



3yoVi ~ 3y y 2 + Vi + 2/iZ/ 2 )G%o 



2\3 



which means that the LMI set ^(A) is the intersection of a cubic and conic LMI. 
The dual curve Q is the union of the quartic 

Qi = {i : - 8x 3 Xi - 18x 2 xl - 18xlxl + 21x\ + 54x^2 + 27:4 = °}> 

a cardioid dual to the cubic factor of p(y), and the conic 

Q 2 = {x : x\ - Ax\ - 4x1 = 0}) 



a circle dual to the quadratic factor of p(y). The numerical range W(A) is the convex 
hull of the union of conv Q i and conv Q 2 , which is here the same as conv Q 1 , see Figure 

m 
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4.5 Polytope 




Figure 5: Left: LMI set J 7 (A) (gray area) intersection of four half-planes. Right: numerical 
range W(A) (gray area) convex hull of four vertices. 

Consider the example of p], Figure 9, p. 147] with 

" 4 -1 " 

-14 

0-1 4 ' 
0-1 4 _ 

The dual determinant factors into linear terms 

p(y) = (yo + %i)(z/o + 3j/i)(j/ + %i + 3/2) (yo + %i - 2/2) 

and this generates a polytopic LMI set .F(A) = {y : ?/o+%i > 0, ?/o+%i > 0, 2/o+%i+2/2 > 
0, + %i - y 2 > 0}, a triangle with vertices (1, -|, 0), (1, -|, |) and (1, -|, -±). The 
dual to curve P is the union of the four points (1,5,0), (1,3,0), (1,4,1) and (1,4,-1) 
and hence the numerical range W(A) is the polytopic convex hull of these four vertices, 
see Figure [51 

5 A problem in statistics 

We have seen with Example 14.51 that the numerical range can be polytopic, and this is 
the case in particular when A is a normal matrix (i.e. satisfying A* A = AA*), see e.g. 
[T51 Theorem 3] or [3 Theorem 1.4-4]. 

In this section, we study a problem that boils down to studying rectangular numerical 
ranges, i.e. polytopes with edges parallel to the main axes. Craig's theorem is a result 
from statistics on the stochastic independence of two quadratic forms in variates following 
a joint normal distribution, see [3] for an historical account. In its simplest form (called 
the central case) the result can be stated as follows (in the sequel we work in the affine 
plane y = 1): 



Theorem 1 Let Ai and A2 be Hermitian matrices of size n. Then det(I n +yiAi+y 2 A 2 ) = 
det(J n + yiAi) det(/ n + y 2 A 2 ) if and only if A\A 2 = 0. 

Proof: If A X A 2 = then obviously det(J n + y\A x ) det(/ n + y 2 A 2 ) = det((J n + yiAi)(I n + 
y 2 A 2 )) = det(/ n + y x A x + y 2 A 2 + yiy 2 A x A 2 ) = det(7 n + y x A x + y 2 A 2 ). Let us prove the 
converse statement. 

Let aijfc and a 2k respectively denote the eigenvalues of A\ and A 2 , for k — 1, . . . , n. Then 
p(y) = det(/„ + 2/2^2) = det(J n +?/iv4i) det(/ n + ?/2^2) = FI fc (H-2/iai fc ) rT fc (H-2/2a 2 fc) 

factors into linear terms, and we can write = \~[ k (l + 2/i a ifc + V2 a 2k) with a\ k a 2k = 
for all = 1, . . . , n. Geometrically, this means that the corresponding numerical range 
W(A) for A = A\ + iA 2 is a rectangle with vertices (mm*; a k , min^ b k ), (min^ a k , max^ b k ), 
(max k a k ,mm k b k ) and (max fc a k , max fc 6 fe ). 

Following the terminology of [H], Ai and A 2 satisfy property L since yiAi + 7/2^2 has 
eigenvalues y\a\ k + y2«2fe for = 1, . . . , n. From [HI Theorem 2] it follows that A\A 2 = 
A 2 Ai, and hence that the two matrices are simultaneously diagonalisable: there exists a 
unitary matrix U such that U*A 1 U = diag fc a lfc and U*A 2 U = diag fc a 2 fc. Since a lk a 2k = 
for all k, we have Y, k a u a 2fc = U*A 1 UU*A 2 U = U* A X A 2 U = and hence A X A 2 = 0. □ 

6 Conclusion 

The geometry of the numerical range, studied to a large extent by Kippenhahn in [13] 
- see [IE] for an English translation with comments and corrections - is revisited here 
from the perspective of semidefmite programming duality. It is namely noticed that the 
numerical range is a semidefmite representable set, an affine projection of the semidefmite 
cone, whereas its geometric dual is an LMI set, an affine section of the semidefmite cone. 
The boundaries of both primal and dual sets are components of algebraic plane curves 
explicitly formulated as locii of determinants of Hermitian pencils. 

The notion of numerical range can be generalized in various directions, for example in 
spaces of dimension greater than two, where it is non-convex in general pE]. Its convex 
hull is still representable as a projection of the semidefmite cone, and this was used exten- 
sively in the scope of robust control to derive computationally tractable but potentially 
conservative LMI stability conditions for uncertain linear systems, see e.g. [16J. 

The inverse problem of finding a matrix given its numerical range (as the convex hull 
of a given algebraic curve) seems to be difficult. In a sense, it is dual to the problem 
of finding a symmetric (or Hermitian) definite linear determinantal representation of a 
trivariate form: given p(y) satisfying a real zero (hyperbolicity) condition, find Hermitian 
matrices A k such that p(y) = det(^ fc y k A k ), with A positive definite. Explicit formulas 
are described in [9] based on transcendental theta functions and Riemann surface theory, 
and the case of curves {y : p(y) = 0} of genus zero is settled in [10] using Bezoutians. A 
more direct and computationally viable approach in the positive genus case is still missing, 
and one may wonder whether the geometry of the dual object, namely the numerical range 
conv{x : q(x) = 0}, could help in this context. 
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